1^1 

TO 4 

A f 

FROM 

DE 

SUBJECT 

OBJET 


Department of Finance Ministere des Finances 
Canada Canada 


Memo to Dcpim* Mimstcr 

ri 1 r> i, DMO.. Orig. + 4 

Paul Rochon dm & gv Dcpu.>-...... i 


Associate DM.1 

EFP.c-copy 

C&C.c-copy 

LAW.c-copy 


Nick Leswick 



Ljuuui I iSr ILI ciSSS^jC UF'Ic f ’ V 

Access to Information 


MEMORANDUH/i ,j|NOTE DE SERVICE 


Security classificalion Classincation dcsccurili ^ 

. , nnaii^ 

SECRET 

Onginalor/Tclephonc number Autcur/Numdro dc telephone 


Carlos Rosell 


Our file Noire reference 


Your file Voire reference 

2018FIN468187 

Dale 


FEB 0 6 2018 


Releasing estimates of the impact of the now defunct Hiring Credit for Small Business 
measure 


For Action. Your decision is required by February 2 in order to release to the El 
Commissioner for Employers a study on the impact of the Hiring Credit for Small Business. 


Tlus memo seeks your approval to make the attached paper available to the El Commissioner 
for Employers by February 2. The El Commissioner plans to use this work for its upcoming El 
Monitoring and Assessment Report (MAR) expected to be published this May. The MAR will 
only refer to some of the results in the paper but the whole study will be made available upon 
request. 

The MAR is an annual publication that provides an analysis of the overall effectiveness of the 
El program in the previous fiscal year. As part of its ongoing assessment and evaluation process, 
each year the Canada El Commission selects topics for inclusion in the Report as supplemental 
studies. 


In 2016 the El Commissioner for Employers requested an analysis of the employment impacts 
of the El Hiring Credit for Small Business (HCSB; 2011 -13) to be added to its 2016-17 Report, 
which is expected to be published this May. 



'ES 


Attached is the current draft of the naner. 

Overall the results 

suggest that the El Hiring credit was not effective in raising employment (its targeted objective) 
or improving firm performance in other dimensions. The only potential positive effect is that it 
helped the employment of unincorporated started-ups. 



ADM: Nick Leswick (613-369-3346) 
Director: Claude Lavoie (613-369-5647) 


s.21(1)(b) 


Canad^i 












- 2 - 


UuuutiieML rwlessBC undf-r 
/Access to Information 

Document divulgue en vertu cie la 



(b) I do not approve 



Budget 2011 introduced the HCSB on a one-year temporary basis. Budgets 2012 subsequently 
extended the credit while Budget 2013 also expanded it. The credit was intended to promote job 
creation by reducing the employer El premiums of small firms. Under the HCSB, eligible firms 
automatically received up to a $1,000 to offset any year-over-year increase in the El premiums 
they paid. Annually, on average about $220 million was paid to about 550,000 businesses. This 
meant benefitting firms each received about $400 in credits or about 0.6 per cent of their 
combined total payrolls and employer El premiums. The fimds to cover the costs of the HCSB 
were charged to the El Operating Account. 


Tlie impact of the HCSB are estimated with firm-level regressions using data firom Statistic 
Canada’s National Accounts Longitudinal MiCrodata File. The empirical methods attempt to 
infer the causal impacts that the credit had on firm; employment, payrolls, productivity, 
revenues, investment, and research and development spending. As well, the analysis separately 
assesses the credit’s impact on pre-existing (i.e. incumbent) and new firms (i.e. entrants /start¬ 
ups). Overall, the estimated impacts are either not statistically different fi-om zero or negative. 
Tlie only exceptions are with respect to unincorporated entrants. In this respect, the analysis 
suggests the HCSB only increased the employment and payrolls of unincorporated businesses 
that started-up once the credit was introduced.^^^^H|^^^^^^^B^^^^^^^^^| 
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Assessing the Hiring Credit for Small 

Business 


1.0 Introduction 

The 2011 federal budget introduced the Hiring Credit for Small Business (HCSB). This measure was 
meant to stimulate job creation and growth among small businesses by limiting increases in employer 
insurance (El) premiums. Specifically, the credit allowed eligible employers in 2011 to offset all or part of 
any increase in premiums over the previous year. The maximum offset was $1,000. To qualify for the 
credit, employer El premiums in 2010 needed to be $10,000 or less. As a result, the credit mostly 
targeted companies that were smaller in terms of their workforce or the amount of insurable earnings 
they paid. However, the credit also helped larger companies if, for example, they started up in 2011.^ 
Finally, the Canada Revenue Agency (CRA) applied the credit automatically when businesses filed their 
taxes. As a result, qualifying businesses did not need to apply for the credit. 

The HCSB was intended to be a temporary one-year measure but in subsequent years, it was extended 
and expanded. Budget 2012 announced the HCSB would be continued an additional year under the 
same parameters as in 2011,^ Budget 2013 was the last budget to include the HCSB. However, in this 
year, the HCSB was expanded. To qualify, employers needed to have paid no more than $15,000 in El 
premiums in 2012 rather than $10,000 as in previous years. Finally, the funds to cover the costs of the 
HCSB were charged to the El operating Account. 

Overall, not much is known about the effectiveness of the HCSB. Indeed, the credit was not contingent 
on additional hiring, growth or any type of performance improvement. Instead, it automatically offset 
any year-over-year increase in El premiums for qualifying firms. This increase could have resulted from 
hiring additional employees or paying higher wages. However, the increase could have also resulted 
from legislated increases in the El premium rate or an increase in maximum insurable earnings. 

To help fill the evidence gap on the effectiveness of the HCSB, this paper uses Statistics Canada's 
business-level National Accounts Longitudinal Microdata File (NALMF). Specifically, the paper assesses if 
the credit helped improve the performance of qualifying firms. To this end, the analysis uses difference- 
in-difference (DD) regressions and regression discontinuity (RD) methods. As well, to help ensure the 
possible impacts of the HCSB are observed, the paper employs these methods to assess the possible 
impact on various margins of firm performance. For all businesses (i.e. incorporated or otherwise - e.g. 
non-profits, religious institutions, governments) the impact is assessed on employment and payrolls. 
However, given that more information is available for incorporated businesses, the impact of the credit 
on corporations is also assessed on productivity, revenues, investment and research and development 
(R&D) expenditures. 

This paper segments the analysis to assess the credit's impact separately for businesses with 
employment in the previous years (i.e. incumbents) and for those without (i.e. entrants). This is in part 


' This was because start-ups were considered to have; paid $0 in El premiurhs in 2010 and fallen below the $10,000 qualification threshold. 

^ To qualify, employers needed to have paid no more than $10,000 in 2011 in El premiums and the maximum credit earned was $1,000 to offset 
El premium Increases between 2011 and 2012. 


000003 




UuuutiieML rclsasyd undf-r ".i -v 
Access to Information 

Document divulgue en vertu de 
Loi sur I'acces a linformation 

out of necessity; the data needed to study entrants in the same way as incumbents are unavaiiabie 
before market entry. As weii, the analysis is segmented in case the HCSB's Impact differs depending on 
the entry status of businesses. 

Overall, the analytical work does not suggest the HCSB helped qualifying firms perform better. We do 
not find evidence that the credit had a positive performance impact for incumbent firms; incumbents 
did not experience a bump in employment, payrolls, productivity, revenues, investment, or R&D 
expenditures. As well, for the most part, entrants did not see improved performance either. Some 
results suggest unincorporated entrants may have grown in terms of employment and payrolls because 
of the credit. However, given the preponderance of evidence, this positive effect needs to be considered 
cautiously because false positives should be expected occasionally. 

Though the overwhelming finding is that the HCSB was not successful in improving firm performance, 
there are some caveats to consider. First, for the most part, the specifications of the DD regressions are 
simple; some elements do not control for time-varying firm characteristics. As a result, missing-variable 
bias could obscure results. However, RD methods attenuate this worry because they confirm many of 
the DD results while not being susceptible to missing explanatory variables. Another consideration is 
that the credit's impact might have been diffused over multiple dimensions. For example, a business 
could have used the credit to increase employment. At the same time, a different business could have 
used the credit to invest or to increase R&D spending. As a result, the credit's impact could have been 
too diffused over different outcomes to be unobservable. 

To assess the impact of the HCSB, the paper proceeds as follows. Section 2 reviews briefly the hiring 
credit literature to provide some context for the HCSB. Section 3 gives a brief overview of the data used 
for the analysis (i.e. the NALMF database). Section 4 outlines some main facts about the El system and 
the credit. This includes estimating the total cost of the program, the number of business that were 
eligible and that actually benefited from the credit. The impact of the HCSB on incumbent businesses is 
assessed in Section 5. To give a robust assessment of the impacts, the paper uses two different 
methodologies: DD regressions in Section 5.1 and RD methods in Section 5.2. Section 6 determines if the 
credit helped the performance of entering firms. This section assesses if the HCSB induced more 
business to enter. As well, the section determines if entrants performed better because of the credit. 

The paper concludes in Section 7 by providing some caveats to the analysis and some broad policy 
implications. 

2.0 Literature review 

Hiring credit programs and other equivalent policies decreasing employer non-wage costs (e.g. payroll 
tax reductions, social contribution relief) are commonly used to encourage employment. This is 
especially true in the aftermath of the Great Recession. However, evidence of the effectiveness of these 
policies is inconclusive arid outcomes seem to depend on whom these efforts are intended to help and 
how programs are administered. The following provides a short overview of the some of the existing 
literature. 

Old papers in the literature on the effectiveness of hiring credits suggest credits are generally 
ineffective. However, as suggested by Neumark (2016), the poor performance observed could be 
because the programs that were studied narrowly targeted types of workers, often disadvantaged 
people. As a result, such credits could have gotten in their own way if employers interpret worker 
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elgibility as a signal of a worker's low productive or high risky, indeed, using an experimental program of 
Targeted Job Tax Credits for welfare recipeints in Dayton Ohio, Burtless (1985) finds worse employment 
outcomes for workers more closely associated with the credits. 

In contrast, recent work suggests hiring credits can encourage employment, at least under some 
conditions. Using variation in US state-level hiring credit programs over the period of the Great 
Recession and after, Neumark and Grijalva (2013) finds that most types of credit programs are 
ineffective. However, this paper finds some exceptions. Specifically, programs that target the 
unemployed, allowed governments to recapture benefits if job creation targets are unmet by 
employers, and programs offering refundable credits succeed in encouraging job creation. 

Cahuc et al. (2017) also shows hiring credit programs can have positive employment effects. For this 
work, Cahuc et al. (2017) uses administrative data from the introduction of the Zero Charges program in 
France in 2008. This program relieved smail firms (i.e. those with less than 10 workers) from their social 
contributions on each new low-wage worker that was hired. This meant employers saved 12 per cent or 
2,400 Euros annually of the labour cost of each new full-time hire that was paid the minimum wage. 

Relief declined to zero once workers were paid 1.6 times the minimum wage. Nevertheless, for workers 
paid 30 per cent above the minimum, employers were still able to save 4 per cent of labour costs of 
each new worker. Overall, Cahuc et al. (2017) finds that the Zero Charges program increased 
employment for low-wage workers by 0.8 per cent. 

Finally, Eurofound (2017) generally reviews the various studies assessing the impacts of hiring credits 
and equivalent policies that reduced non-wage labour costs throughout European Union countries since 
2000. The main finding is that policies like hiring credit generally succeed in spurring hiring. However, it 
is still very common for such programs to be ineffective. For example, Eurofound (2017) finds that in 
about 40 per cent of case, programs reducing non-wage costs were found to be ineffective. 

3.0 Data 

To assess the impact of tjie HCSB, the analysis uses Statistics Canada's National Account Longitudinal 
Microdata File (NALMF). This resource contains information on the universe of incorporated and 
unincorporated businesses from 2000 to 2014. The NALMF includes data from various sources. For 
example, the Business Register provides firm information on industry affiliation, the province of 
residence, and country of control. The Statement of Remuneration Paid gives information on payrolls. 

The Payroll Deductions and Remittances provides a monthly approximation of firm employment. Finally, 
corporate tax files provide further information. Tax records give balance sheet and income statement 
information through the General Index of Financial Information (GIFI) that incorporated firms must file 
while other tax records provide information on investment and R&D expenditures.^ 

Much of the data contained in the NALMF are administrative in nature. Despite this, information can be 
missing or incorrect. Moreover, the NALMF does not collect information on employer El premiums, a 
key variable in the analysis. However, for the purposes of this study, employer El contributions are 
approxinriated from available insurable earnings data and historical statutory premium rates. 

Finally, the NALMF's unit of analysis for this study is the 9-digit Canada Revenue Agency (CRA) business 
number. This level of disaggregation allows for firm-level analysis of the impact of the HCSB using DD 


^ R&D expenditures reflect tax credit claims filed under the Scientific Research and Experimentai Development program. 
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regressions and RD methods. It also allows firm-level data to be aggregated to show broad trends within 
industries or regions, for example. 


4.0 Background 

This section outlines the major long-run trends related to the El system. It also focuses on specific details 
regarding the HSBC. Specificaliy, it estimates the total credits paid from 2011 to 2013 and how this was 
distributed across different types of businesses and across regions. This section also gives detail on the 
average magnitude of the credit received. It does so by comparing credit amounts relative to a business' 
total El premiums as well as relative to the total sum of a business' El premiums and total payroll. 

The results in this section are based on businesses that both issued at least one T4 and that had positive 
payrolls. These firms are considered to be in operation because they show consistent signs of 
employment.'* However, it is possible that some firms are excluded from the analysis because of missing 
data while others are included because data errors make them look as if they had employment. 
Consequently, the results presented here approximate actual values. 

4.1 Long-run trends in the El system 

Figure 1 shows that the number of businesses with employment gradually increased over time. From 
2000 to 2014, the number of all businesses in Canada increased at an average rate of 1.6 per cent. This 
increase was driven by incorporated businesses.® The number of these businesses increased at a higher 
rate, 2.9 per cent per year. As a result, incorporated businesses increased as a share of all businesses 
from 61 per cent in 2000 to 73 per cent by 2014. 

Figure 1: Number of businesses, 2000-2014 

Thousands 



0 

2000 2002 2004 2006 2008 2010 2012 2014 


Source: NALMF 

Noto: Author's cacluations based NALMF data. **A1I businesses" refers to incorporated and all other firms. Businesses considered are only 
those with positive annualTAs Issues and positive payrolls. 


Total employer El premiums increased in nominal terms from about $11.5 billion in 2000 to $14.0 billion 
in 2014 at an average rate of 1.4 per cent (Figure 2). As with the increase in the total number businesses. 


‘ For the purposes of this paper, only businesses with employment are considered to be in operation even though some businesses can exist 
without employment. The specific variables that this study uses to determine if a firm employs workers differs somewhat between sections. Each 
section highlights this change. 

^ Each incorporated businesses reflects a distinct 9-digit CRA businesses number that filed a corporation income tax return in a given year. 
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El premiums paid by incorporated firms increased more quickly thaii bn aggregater Premiurns paid by ^ * 

incorporated businesses increased from about $7.1 to $9.0 billion at an average rate of 1.7 per cent. 

Figure 2: Total nominal employer El premiums, 2000-2014 
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Source: NALMF 

Note: Author's cacluationsbased NALMF data. "All businesses* refers to incorporated and all other firms. Businesses considered are only 
those with positive annualT4s issues and positive payrolls.Amounts are in nominal terms. 


On average, in nominal terms, each business paid about $11,400 in El premiums in 2000 (Figure 3). 
Moreover, incorporation status did not matter until 2008 when premiums began growing slower for 
incorporated businesses compared to all businesses on average. By 2014, the slower rise in premiums 
paid by incorporated firms left these businesses paying about $1,300 or 12 per cent less than the 
average firm. 


Figure 3: Average nominal employer El premiums paid per business, 2000-2014 
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■ Incorporated 



2000 2002 2004 2006 2008 2010 2012 2014 

Source: NALMF 

Note; Author's cacluationsbased NALMF data. "Ail businesses" refers to incorporated and all other firms. Businesses considered are only 
those with positive annualT4s issues and positive payroifs. Amounts arc in nominal terms. 
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4.2 The HCSB 

4.2.1 General background 

On average, nominal annual aggregate HCSB credit payments ranged between $212 to $235 million 
dollars or about 1.8 per cent of total employer El premiums. Moreover, Table 1 shows that just over 90 
per cent of all active businesses each year between 2011 and 2013 qualified for the HCSB.® However, 

Just under half of all qualifying businesses received a positive credit amount. Mechanically, this is 
because these firms did not see year-over-year increases in the El premiums they paid. Finally, each firm 
that received a credit earned on average about $400 over the three years. To give some perspective, this 
credit amount equalled about a third of each employer's El premiums but less than one percent of total 
employer El premiums and payrolls. 

Table 1; Aggregate HCSB details_ 



2011 

2012 

2013 

Employer premiums ($1,000,000) 

11,600 

12,568 

13,439 

Total credit amount paid ($1,000,000) 

212 

219 

235 

Number of sample businesses 




Total, all businesses 

1,203,481 

1,219,698 

1,230,732 

Qualifying for HCSB 

1,103,214 

1,111,904 

1,149,870 

Receiving HCSB credit 

548,470 

547,692 

559,687 

Average credit amount received per 
benefiting business ($) 

387 

400 

420 

Average subsidy rate relative (percent) 




Employer El premiums 

34.3 

33.9 

32.2 

labour costs (i.e. payroll * 

0.6 

0.7 

0.6 


employer El premiums) ' 


SosrccrffAlMF NelcAvlhgi'i ctIcUJIiont tt>«4 NAlMf (orvUt'ctf •rter^lhott«rlttip9llll¥>»tw«0l 

lAiltlWCSand pofUhr<piT*a(ll<DeIUr •mobnlt «it innomlniiltn**. 

4.2.2 Firm employment size 

The credit successfully targeted businesses that employed fewer workers. Panel A of Table 2 illustrates 
the distribution of qualifying and benefiting firms as well the distribution of HCSB payments over 
different firm-employment size categories.^ More than 85 per cent of qualifying and benefitting firms ' 
employed fewer than 10 people. However, at most only about 80 per cent of the aggregate annual 
credit was paid out to these smaller firms. This was because, despite their greater number, smaller firms 
received on average a lower credit amount. For example. Panel B of Table 2 shows that in 2013 the 
average credit paid to each firm increased from about $372 for firms with less than 10 workers to 
$1,000 for firms with 500 or more workers. Finally, the relative magnitude of the subsidy declined with 
firm size. For example, as a share of employer El payments and payrolls, the credit decreased from 0.6 
per cent for businesses with less than 10 workers to 0.002 per cent for large businesses that employed 
at least 500 workers. 


^ The high share of qualifying businesses reflects that the vast majority of all businesses are small. 

^ This study uses the average monthly employment inferred from PD7s to approximate employment within each business. This is the most 
accurate employment measure available in the NALMF. Each month, businesses remit to the Canada Revenue Agency their statement of account 
for current source deductions, a PD7 form. This statement provides information on the paid workers a business employs, allowing business 
employment to be inferred. 
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A; Distribution of HCSB benefits (per cent) 



Qualifying businesses 

Benefitting businesses 

Aggregate HCSB payment 


2011 

2012 

2013 

20U 

2012 

2013 

2011 

2012 

2013 

Number of woifcers 

less than 10 

92.9 

93.3 

91.0 

89.0 

89.4 

8ai 

80.1 

8L1 

75.6 

10toi» 

7.0 

6.6 

8.9 

10.9 

10.5 

13.7 

19.5 

18.5 

23.8 

50 to 99 

0.1 

0.1 

0.1 

0.1 

0.1 

0.2 

0.3 

0.3 

0.5 

lOOf 

0.03 

0.03 

0.03 

0.04 

0.04 

0.05 

0.1 

0.1 

0.1 

Total 

100 

100 

100 

100 

100 

100 

100 

100 

100 


8; HCSB subsidy amount by business she 



Average credit amount ($) 

Credit as share of employer B 
premiums (per cent) 

Credit as share of employer B 
premiums and payrolls (percent) 


2011 

2012 

2013 

2011 

2012 

2013 

20U 

2012 

2013 

Number of workers 










less than 10 

351 

365 

372 

70.7 

69.8 

69.6 

0.6 

0.6 

a6 

10 to 49 

699 

710 

735 

34.8 

34.3 

33.5 

0.2 

a2 

0.2 

50 to 99 

930 

921 

903 

10.5 

las 

8.9 

0.1 

0.1 

0.1 

unto 499 

947 

949 

943 

5.5 

5.6 

5.1 

0.04 

0.(S 

0.06 

SOOf 

904 

944 

1000 

27 

3.3 

3.4 

0.03 

0.01 

0.002 
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4M 4nd SOa« woflcKrcKMorlci bso 4IM* c«tcf onr haoNtt# of iutbiln COkkI* dtacknwo ra>ttktto«» lo crolact corapntocaiMeftiaQtv. 

4.2.3 Firm age 

Though the HCSB successfully targeted small businesses, it did not mean qualifying firms were also 
young. Panel A of Table 3 shows that more than 60 per cent of qualifying businesses were at least 5 
years old. This emphasis on older firms largely reflects the age distribution of businesses more broadly in 
the economy; the distribution of quaiifying firms in Panel A is very similar to that of the universe of all 
businesses. However, in relative terms, the distribution of aggregate HCSB payments favoured younger 
businesses. For exampie, in 2013 business younger than 3 years of age received about 28.9 per cent of 
aii HCSB credit payments even though they represented only 18.2 per cent of all businesses. Small 
businesses received relatively more of all HCSB payments because they each received on average a 
greater credit amount. For example, in 2013, Panel B shows firms that were 1 or 2 years old, got on 
average $527 compared to businesses that were at least 5 years old and got $387. Finally, the subsidy 
rate that the credit offered was smail. As a share of combined employer El premiums and payrolls, the 
credit was no higher than 2 per cent for any firm of any age. Moreover, this rate deciined with firm age. 
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Ai Distribution of businesses (percent) 


HCSB qualifying businesses Universe of businesses Aggregate HCSB payment 



2011 

2012 

2013 

2011 

2012 

2013 

2011 

2012 

2013 

Age of business 

0 

5.8 

5.8 

5.5 

53 

5.3 

5.2 

10.3 

10.3 

9.6 

1-2 

14.2 

14.3 

13.7 

13.3 

13.3 

13.0 

20.7 

20.6 

19.3 

3-5 

17.9 

17.2 

16.5 

17.1 

16.4 

15.9 

15.9 

15.6 

15.1 


62.1 

62.8 

64.2 

64.3 

65.1 

66.0 

53.1 

53.5 

56.0 

Total 

100 

100 

WO 

100 

100 

100 

100 

100 

100 


B! HCSB subsidy amaunt by business age 



Average credit amount ($) 

Credit as share of employer El 
premiums (percent) 

Credit as share of employer El 
premiums and payrolls (percent) 


2011 

2012 

2013 

20U 

2au 

2013 

20U 

2012 

2013 

Age of business 

0 

447 

469 

480 

9ao 

89.1 

88.4 

L9 

195 

199 

1-2 

482 

507 

527 

50.3 

50.2 

48.8 

1.0 

10 

10 

3-5 

382 

392 

411 

32.2 

311 

31.0 

0.6 

0.6 

0.6 

5f 

353 

362 

387 

2L8 

2L7 

2a4 

0.4 

0.4 

0.4 


SeomNAllir NotcAuttBf^cikiiatom btatd NAUir caBsMmdaraatfyttDttiitatpoflUMMnuadTAtbiBOBndpotBhtpivmDs.&elBrBiBOiattBrftlAneBtaiittfm.BiAlDnsgtBii 

dctcrwiecd bncd onthiflfst tbotj 6«Aln0«* bialntig mnfacr b tint obstrvtd kittM NAlMf. 


4.2.4 Regions 

Overall, the regional representation of qualifying businesses and the HCSB payments were similar. 
Moreover, these distributions followed very closely from the distribution of the universe businesses 
across Canada. For example. Panel A in Table 4 shows that 35, 20, 15,15 and 15 per cent of qualifying 
businesses resided respectively in Ontario, Quebec, Alberta, British Columbia and all other provinces 
and territories combined. This was very similar to the distribution of firms in the universe of businesses. 
Panel B of Table 4 shows that per business across region, firms that benefited from the HCSB received 
between about $340 and $530 in 2013. The highest average credit amounts were paid to businesses 
located In the Territories; between 2011 and 2013 businesses in the Territories received about 26 to 31 
percent more credits than the national average. Finally, as a share of payrolls and El premiums, the 
credit amount was no greater than 0.8 per cent in any identified region. 
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Table4;Plstribimonofthe HCSB by region __ 


A: Mstributlon of businesses (percent) 


HCSB quaBfylng businesses _ Universe of businesses Aggregate HCSB payment 



20U 

2012 

2013 

2011 

mi 

2013 

2011 

2012 

2013 

Region 










Alberta 

1A.9 

1S.2 

1S.3 

14.7 

15.0 

15.2 

13.4 

13.9 

14.4 

B.C 

15.9 

15.7 

15.5 

15.7 

15.6 

15.4 

15.4 

15.6 

15.6 

Manitoba 

3.1 

3.1 

3.1 

3.1 

3.2 

3.2 

3.3 

3.3 

3.3 

New Brunswick 

2.1 

2.0 

EO 

2.1 

10 

10 

12 

2.1 

11 

Newfoundland 

1.6 

1.6 

1.6 

16 

16 

16 

1.8 

17 

17, 

Nova Scotia ' 

2.4 

2.3 

2.3 

Z4 

13 

13 

15 

15 

2.4 

Ontario 

35.3 

35.5 

35.7 

35.5 

35.7 

35.8 

33.9 

33.3 

33.6 

P.EI 

0.5 

0.S 

0.4 

as 

as 

04 

05 

OS 

0.4 

<biebec 

20.1 

19.9 

19.8 

20.2 

20.0 

19.9 

22.2 

212 

216 

Saskatchewan 

3.4 

3.4 

3.5 

3.4 

3.4 

3.4 

3,7 

3.8 

3.8 

Tenitottes 

0.3 

0.3 

a3 

OJ 

0.3 

03 

04 

04 

0.4 

Missing region 

as 

0.5 

0.5 

0.5 

as 

0.5 

07 

0.7 

06 

Total 

100 

100 

100 

100 

100 

100 

100 

100 

100 





ih HCSB subsidy amount by region 





Average credit amount ($) 

Credit as share of employer El 

Credit as share of employer El 





premiums (per cenQ 

premiums and payrolls (percent) 


20U 

2012 

2013 

20U 

2012 

2013 

20U 

2012 

2013 

Re^on 










Alberta 

450 

465 

492 

37.4 

37.2 

35.0 

0.7 

0.7 

0.7 

&C 

399 

412 

435 

37.2 

3ai 

33.8 

0.7 

0.7 

07 

„ Manitoba 

402 

412 

430 

32.3 

317 

302 

0.6 

07 

06 

New Brunswick 

355 

358 

380 

30.7 

30,1 

208 

06 

06 

0.6 

Newfoundland 

323 

329 

343 

35.9 

34.9 

33.0 

08 

08 

08 

Nova Scotia 

350 

362 

378 

30.4 

29.8 

28.5 

06 

07 

06 

Ontario 

387 

395 

415 

34.1 

33.8 

312 

0.7 

0.7 

07 

P.E.I 

337 

344 

357 

30.5 

302 

209 

0.7 

0.7 

07 

Quebec 

357 

372 

388 

318 

316 

301 

0.5 

05 

05 

Saskatchewan 

419 

437 

462 

34.3 

34.4 

313 

0.7 

07 

0.7 

Territories 

506 

512 

530 

33.0 

33.0 

29.4 

07 

07 

0.6 

Missing region 

413 

449 

435 

55.10 

5118 

5110 

12 

11 

11 
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4.3.5 Industrial sector 

The distribution of firms qualifying for the HCSB was very similar to the distribution of all businesses in 
the economy.^ For example, Panels A of Table 5 shows that of HCSB qualifying businesses, about 68.8 
per cent were affiliated with the services sector in 2013. This was the same share as in the universe of 
businesses in the overall economy. In terms of the distribution of payments, however, relatively less of 
all the credit went to services. For example, in 2013, only about 63.7 per cent of aggregate HCSB 
payments were made to firms in this sector. This underrepresentation in totaj credit payments is due to 
the lower payment per firm; Panel B of Table 5 shows that in 2013 the average firm in service received a 
credit amount of about $402. This was the second lowest average payout among all sectors. Of interest 
is that, firms in Mining, Quarrying and Oil/Gas Extraction consistently received greater credit amounts 
on average than firms in other industries. In 2013, for example, firms in the resource sectors received on 


* of note here is that a non>trivial share of firms had missing industry identification. 
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average about $577 dollars from the credit. This amount was about 10 per cent greater than the 
average payment in construction, the second highest average payment. Finally, on average, no firm in 
any identified industry got a subsidy rate greater than one per cent of combined El employer premiums 
and payrolls through the HCSB. 


Table S: Oistribution of the HCSB by Industrial sector 


A: Distribution of businesses (per cent) 


HCSB quallfylne businesses Unluerse of businesses Aggregate HCSB payment 


2011 

2012 

2013 

20U 

20U 

2013 

2011 2012 2013 


Industrial sector 










Agriculture, Forestry, 

4.7 

4.7 

4.7 

4.5 

4.5 

4.5 

3.7 

3.7 

3.9 

Fishing and Hunting 










Mining, Quarying, 

0.7 

0.7 

0.8 

0.7 

0.8 

0.8 

0.8 

0.6 

0.6 

Extraction 










Utilities 

0.0 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

0.1 

Construction 

10.7 

10.7 

11.8 

10.8 

10.8 

11.8 

12.7 

12.9 

14.4 

Manufacturing 

3.2 

3.0 

3.4 

4.0 

3.8 

4.0 

4.2 i 

4.0 

4.7 

Services 

6S.3 

64.4 

68.8 

65.6 

64.8 

68.8 

58.9 

S8.9 

63.7 

Public administration 

0.3 

0.3 

0.3 

0.4 

0.5 

0.5 

0.5 

0.5 

0.6 

Missing Industry 

15.1 

16.1 

10.2 

13.9 

14.8 

9.6 

19.3 

19.2 

12.1 

Total 

100 

100 

100 

100 

100 

100 

100 

100 

100 





B: HCSB subsidy amount by business age 





Average credit amount ($) 

Credit as share of employer El 

Credit as share of employer El 





premiums (per cent) 

premiums and payrolls (percent) 


2011 

2012 

2013 

2011 

2012 

2013 

20U 

2012 

2013 

Industrial sector 










Agriculture, Forestry, 

308 

319 

345 

33.7 

32.6 

32.2 

0.6 

0.6 

0.6 

Fishing and Hunting 










Mining, Quarying, 

614 

575 

577 

32.7 

32.7 

30.9 

0.5 

0.5 

0.5 

Extraction 










Utilities 

418 

443 

482 

21.5 

23.0 

21.2 

0.4 

0.4 

0.4 

Construction 

482 

492 

524 

37.3 

36.9 

36.4 

0.6 

0.7 

0.7 ^ 

Manufacturing 

473 

485 

521 

23.5 

23.5 

23.6 

0.4 

0.4 

0.4 

Services 

358 

373 

402 

27.2 

27.0 

26.3 

0.5 

0.5 

0.5 

Public administration 

439 

439 

SOS 

13.9 

14.1 

12.6 

0.3 

0.3 

0.3 

Missing industry 

439 

442 

412 

62.2 

59.8 

63.2 

1.2 

1.2 

1.4 


SotfCrNAlMf Note: Author*! cakUitiortt bated NAlMr data, fiutirvitet comtdered areen.'f thaie«(th peilthreamui tdthaun and poilttve payifiQt.boDar amotest ate lnneR)l.-ul inim. Induitrul teciart are detetnaned br broad 2* 
dielt NAteS tatetorlc! 

5.0 Incumbent analysis 

The challenge of identifying the causal impact of policies like the HCSB is that it is not possible to 
observe how firms perform both with and without the policy. If this were possible, the performance 
difference between a firm operating with the policy and the same firm working without the policy would 
reflect this impact. In lieu of this ability, econometric techniques can be used. These methods exploit 
differences in gains from the policy that are unrelated to unobserved firm characteristic that also affect 
performance. 

This paper uses DD regressions and RD methods to identify the causal impact of the HCSB. Though 
different, these methodologies estimate the policy impact by seeing if the performance improvements 
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among qualifying firms over time was greater than among firms that did not qualify. Each method is 
discussed in turn in the following subsections. 

5.1 Difference-in-difference 

The underlying premise of DD regressions in the context of assessing the HCSB is that it is possible to 
benchmark the performance of firms that qualified for the credit against the performance of firms that 
did not. In a sense, firms that did not qualify are thought to show what the expected change in 
performance would have been without the credit. Consequently, the difference in the change in 
performance between qualifying over none-qualifying firms is taken to reflect the policy's causal Impact. 

To implement the DD regressions, the following equation is estimated with firm-level panel data, 

Yft = aTQualifyfty-PostPolicyt + aEQualifyft + af + at + Eff 
In Equation (1): 

• The variable yft reflects firm /'s performance (e.g. employment, payroll, productivity) in year t; 

• Qualify ft is an indicator variable that equals one if, in the year before t, the firm's El premium 
was no more than the threshold to qualify for the credit; 

• PostPolicyt is an indicator variable that equals one for years when the HCSB was in effect; and, 

• Uf and at are respectively firm-fixed and year-fixed effects.® 

The key coefficient of interest in Equation (1) is ttj-. While the coefficient measures the average 
performance difference between qualifying and non-qualifying firms in years when the HCSB was not in 
effect, the coefficient measures by how much this difference improved for qualifying firms once the 
credit was implemented. As a result, Uf is taken to reflect the causal impact of the HCSB on firm 
performance. If this coefficient were positive and statistically significant, it would suggest that firms that 
qualified for the credit after it was implemented improved their performance relative to peers that did 
not qualify. As a result, one would see evidence that the HCSB was effective. If this coefficient were 
instead negative or statistically insignificant, no evidence would be observed suggesting that the credit 
helped firm performance. 

A consideration in inferring the causal impact of the HCSB from estimating Equation (1) is that Ut could 
be determined by general data trends that pre-existed the introduction of the HCSB. In this case, the set 
of firms that do not qualify for the credit would be ill suited to benchmark the performance of qualifying 
firms. That is, if the performance of qualifying and non-qualifying businesses were already diverging 
before the implementation of the credit then, ay would conflate the possible continuation of these 
"pre-trends" with any possible impact that the credit might have had. As a result, the evidence from DD 
estimation would be questionable. 

To address the concern of pre-trends, this study tests for the existence of such trends in the data. This 
analysis is presented in Annex I. Overall, the data do not show pre-trends for employment, payrolls and 
productivity. As a result, the remainder of Section 5.1 provides the estimates of Equation (1) when only 
these three variables are set as the dependant variable. A broader look at the effects that the HCSB 


’ Equation (1) could control for additional firm characteristics that affect performance. For the exercise here, no additional controls are included 
even though this could bias results. However, preliminary analysis using time varying control variables did not change general conclusions. 
Moreover, as will be seen, the use of firm fixed effects already controls for a substantial portion of the variation in outcomes. Final ly, RD results 
that are less susceptible to missing variable bias are discussed in the next section to show the robustness of the general conclusions reached with 
DD regressions. 
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might have had on these variables as well as on firm revenues, investment and R&D expenditures are 
left for the RD analysis in Section 5.2. 

5.1.1 Incumbent sample 

The DD analysis uses four years of data from 2009 to 2012. To be included in the sample, firms must 
have shown consistent evidence of employment in between 2009 and 2012. To show consistent 
evidence of employment in a given year, businesses must have shown positive: employment as 
suggested by PD7 issuances, pay rolls, and, employer El premium contributions. A business is excluded 
from the sample if any of these three pieces of information are missing or are not positive because it 
makes uncertain if the firm had employment. As well, to be included businesses must have shown to be 
incumbents in each of the four sample years. In any given sample year, this was demonstrated by 
positive El contributions in the preceding year. 

5.1.2 Incumbent difference-in-difference casual impacts 

Overall, the empirical evidence suggests that HCSB did not promote incurnbent firms growth. Using 
quasi-Maximum Likelihood Poisson estimation. Panel A of Table 6 shows that all businesses that would 
have qualified for the credit before its implementation were about 19 per cent smaller in terms of 
employment and payrolls than their counterparts that would not have qualified. This is expected 
because the HCSB typically focused on smaller finns. More importantly, estimates of suggest that 
qualifying firms became smaller once the credit was introduced. Qualifying firms became 2.1 and 3.9 
percentage points smaller than non-qualifying firms in terms of employment and payrolls, respectively. 

The results in Panel B re-estimate Equation (1) based only on data from incorporated firms and they 
confirm the conclusion from Panel A; the HCSB does not seem to promote the growth of incorporated 
businesses. Incorporated firms that would have qualified for the credit in 2009 or 2010 employed 19 per 
cent fewer workers and paid 20 per cent less in payrolls than corporations that would not have 
qualified. Once the credit was implemented, employment and payrolls for qualifying businesses 
decreased respectively by 1.9 and 3.9 percentage points. Given that, these estimates are statistically 
significant at one per cent, these results suggest that the HCSB did not promote the firm growth and 
instead that it was associated with a contraction in firm size. 

The results in Panel B also suggest that the HCSB did not promote the productivity growth of 
incorporated firms. Prior to the implementation of the credit, firms that would have qualified for the 
credit were indistinguishable from their benchmark firms; qualifying firms appeared to have been about 
4.1 per cent more productivity but, because this estimate is not statistically significant, there does not 
seem have been a meaningful difference. Moreover, though after the credit's implementation, 
qualifying firms appeared to have become relatively more productive by about 2.1 percentage points, 
this estimated improvement was not statistically different from zero. As a result, the DD estimates imply 
that the HCSB did not help firms improve their productivity. 


These criteria are used to ensure that firms that did not have employment enter the sample due to a data error In one of these three variables. 
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A: All businesses _ _B: Incorporated businesses 


Dependent variable 

Employment 

Payroll 

Employment 

Payroll 

Productivity 

ap 

-0.021** 

(0.004) 

-0.039** 

(0.003) 

-0.019** 

(0.004) 

-0.039** 

(0.003) 

0.021 

(0.033) 


-0.185** 

(0.007) 

-0.194** 

(0.009) 

-0.190** 

(0.006) 

-0.204** 

(0.007) 

0.041 

(0.064) 

Firm-fixed effects 

YES 

YES 

YES 

YES 

YES 

Industry-Year fixed effects 

YES 

YES 

YES 

YES 

YES 


0.99 

0.99 

0.99 

0.99 

0.81 

Observations 

2,120,461 

2.120,461 

1,567,321 

1,567,321 

1,478,049 


Note:This table shows key coefficient estimates for Equation (IJ.Panel A Is basedon data from all firms (l.e. incorporated and unincorporated businesses) while 
P anelB Is based only on Incorporated businesses. The number of observations differ depending on the dependent variable used because data for these variables 
maybe missing for different obs ervatio ns. S am pies may be unbalanced due to missing NA ICS Information In some years. Indus try*ye a r fixed effects are based on 2* 
digit NAICS classes. Poisson quasi-maximum likelihood estimation Is used to estimate Equation (}). Robust standard errors in parentheses. ** 1 per cent 
s Ignlflcance^ *5 per cent significance. 


Analysis based on DD regressions does not suggest that the HCSB had a positive impact on the 
performance of businesses. However, it is difficult to believe that the credit caused a relative decrease in 
performance as suggested by the negative and statistically significant estimates of for employment 
and payroll growth. Misspecification of Equation (1) could be responsible for these results if an 
important time-varying firm control is missing that would bias the estimate of a-p. To account for this 
potential bias, the next sub-section utilizes RD methods, methods that do not depend on the correct 
specification of regression equations, to determine the causal impact of policies like the HCSB. 

5.2 Regression discontinuity 

This study uses RD analysis for two reasons. First, an inability to control correctly for time-varying firm 
characteristics in the DD regression estimates could confound analysis based on DD regressions. And, 
second, credit eligibility implies that eligible firms will be different from their comparison group (e.g. 
businesses eligible for the credit will be smaller than those that are ineligible). As a result, businesses 
that did not qualify might not be an appropriate benchmark off which to measure the gains of 
businesses that were eligible. RD methods can avoid these problems and add some robustness to the 
main conclusion reached with the DD analysis that the HCSB did not promote firm growth or 
performance. 

RD analysis addresses concerns that might weaken DD results by focusing on businesses near the El 
premium threshold that determined credit eligibility. The intuition for this is as follows: if firms were 
unable to manipulate perfectly their El premiums then, randomness would be an important factor 
determining eligibility for firms close to the threshold. In this case, differences in firm characteristics 
would be independent of eligibility status and a direct comparison between eligible and ineligible 
businesses near the threshold can give an unbiased estimate of the impact of the HCSB. 
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To implement the RD method in the context of the HCSB, the local polynomial regression represented 
by Equation (2) is estimated. 

N N 

bXf = OrQualifyf + ^ Pi{EI Premium/f + ^ /<(£/ Premiurnff y.Qualifyf + o)f. (2) 

(=0 

In Equation (2), AYf represents the percentage change in firm/s performance from an initial year tto a 
subsequent year Qualifyf is an indicator variable identifying if/qualified for the credit by having 
paid no more than the El premium threshold in year t, and El Premiunif reflects the El premiums/paid 
in t. As a result, Equation (2) explains changes in firm performance as a function of whether firms 
qualified for the HCSB and a polynomial function of the firm's El premiums. Other explanatory factors 
can be ignored because, by the construction of the sample around the HCSB qualifying threshold, firms 
above and below this threshold are nearly randomly assigned. 

The coefficient of interest in Equation (2) is a^. This is because the coefficient will indicate whether 
businesses that qualified for the credit on average improved their performance by more than firms that 
did not qualify. If the credit was effective, the resulting performance bump should have been systematic 
enough to yield a positive and statistically significant estimate of a^. 

Two assumptions underpin the validity of the RD method. To be convincing studies utilizing RD typically 
test for these. In the context of the HCSB, the first test examines if firms manipulated the El premiums 
they paid in period t in order to benefit from the credit. This is an important test because, if firms 
succeeded in manipulating their premiums then, estimates of Ut could be susceptible to selection 
bias.^ The second test investigates if, ex-ante, firms above and below the qualifying threshold were 
already systematically different. The rationale for this is that if firms above the threshold were innately 
different then, they could not serve as a valid benchmark for firms below the threshold. This test is 
implemented by estimating Equation (2) on firm characteristics that were predetermined before the 
introduction of the HCSB. 

Both tests examining the validity of RD methods in this study are presented in Appendix II. In general, 
the results suggest RD analysis is valid to assess the effectiveness of the HCSB. The remainder of Section 
5.2 presents this assessment. 

5.2.1 RD Results 

Results on the effectiveness of the HCSB focus on the improvement the credit might have had on year- 
over-year growth from 2010 to 2011 and from 2012 to 2013. For businesses that went out of business 
from one year to the next, the change in performance used to calculate their growth rate was set to 
equal the full amount in the base year. For example, the change In employment experienced by a 


” The regression Is considered to be 'local* because only observations around the qualifying threshold are used. 

” To be specific, tYf “ ^^00. The base of this change is the average value between years to minimize the possible effects of 

mean reversion. 

“ With selection bias, the estimate of aj could exaggerate the impact of the credit by confounding improvements in firm performance that 
would have happened even without the credit's benefit. For example, Arms that knew they would have grown In size between yea r t and ( even 
without the credit might have reduced their employment in year tto bring their El premiums below the HCSB threshold. 
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business that initially employed 50 people in 2010 but that was not in business in 2011 was set equal to - 
SOS'* 

5.2.1.1 Impact on employment and payrolls 

Table 7 shows estimates of the coefficient a-r that confirm the general conclusion from the DD analysis 
in Section 5.1.2; the RD estimates show that the HCSB did not promote businesses growth. Based on 
local polynomial regressions of degree 2, Table 7 shows that growth in employment and payrolls of all 
qualifying firms was not different from what was experienced by firms that did not qualify.^® 

For all businesses, Panel A.l shows the estimated impact of the credit on the employment and payroll 
growth rate from 2010 to 2011, when qualifying firms needed to have paid no more than $10,000 in El 
premiums in 2010. For employment and payrolls alike, the increase in the growth rate that the credit 
provided was not statistically different from zero even though the point estimates are respectively 
about 1.2 and 1.4 percentage points. Similarly, Panel A.2 suggests that when the qualifying threshold 
was raised to $15,000 in 2012, the credit also did not raise the annual growth rate of employment and 
payrolls from 2012 to 2013. The estimates for were negative but, again, not statistically different 
from zero. 

Evidence for incorporated businesses shown in Panel B of Table 7 are similar to those of Panel A; these 
results also suggest that the HCSB did not have a positive impact on growth. For example, incorporated 
businesses qualifying for the credit based on their 2010 El premiums saw their employment gro\wth rate 
to be 0.6 percentage points higher than if they had not qualified. However, this improvement was not 
systematic enough to be statistically significant. 


Results are equivalent if businesses that went out of businesses in year t' are excluded from the sample. This suggests that the way growth is 
calculated for exiting businesses does not drive results. 

Lower order local polynomial regressions were estimated. These results are not shown but their conclusions are consistent with what is shown 
in Table 7; estimates of or,, in Equation (2) are also statistically insignificant and suggest that the HCSB did not promote firm performance. 
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Table 7: Regression discontinuity resuits foreniployment and payrolis, annual growth rates 
(percentage points) _ 

_ Panel A: All businesses 


Panel A.l: Year-over-year from 2010 Panel A.2: Year-over-year from 2012 



Employment 

Payroll 

Employment 

Payroll 


1.233 

1.372 

-1.288 

-0.464 


(0.863) 

(0.858) 

(0.822) 

(0.802) 

Bandwidth 

3,464 

3,317 

6,341 

6,159 

Observations 

64,358 

61,150 

69,476 

66,929 



Panel B: Incorporated businesses 



Panel B.l: Year-over-year from 2010 

Panel B.2: Year-over-yearfrom 2012 


Employment 

Payroll 

Employment 

Payroll 

“T 

0.570 

0.821 

-0.930 

-0.322 


(0.787) 

(0.848) 

(0.844) 

(0.811) 

Bandwidth 

4,047 

3,343 

6,127 

6,117 

Observations 

70,687 

55,995 

60,732 

60,602 


Note:Thti Ubte ihoM the RO eitCmjtei fdrthe Impiei of the MCSB foeelbutinetiei end for only Incorpoteted buttneitot.^oncl A.lond 
6 JeiKmatethelnerernenullmpecton fnnirowih from 20Sto2011A> a result.for theiepaneb. the Indketor variable Qustify bi Equation 
(2) b defined by mhethcr bi 202), Ct premkimi were no fteater than $X),000. Pane) A J ervd B Jshowtheyear-ovei'Vear Impact of the credo 
from 20X1. AI a result the indicator QuaCfy in equation {2} b deRrted by the $S4)00CI premtum threshold. Local area polynomial regressions 
are used to estimate the HCSfi Impact These rvgresstoru use a triangular hemel to give obscivaUons closer to the qualification threshold 
more influence. fInaRy, a symmetric rtelghborhood using thettatedbandw(dth(eipressedlndollan) around the Cl threshold b Implemented to 
determine the sample.Signlfkanec bated on convcnHonaittandard errors are shovm in parenihesb.**lpercentslgnifieanee,*S percent 

5.2.1.2 Productivity, revenues, investment, and R&D 

Table 8 illustrates more broadly, though only for incorporated businesses, that the HCSB did not have a 
positive impact on firm performance. It does so by investigating the credits impact on the growth rate of 
productivity and revenue (Panel A) and on the change in investment and R&D expenditures (Panel B).^® 

For productivity and revenue, the credit's impact on growth is not observed year-over-year from 2010, 
Panel A.l. Productivity growth was about 6.1 percentage points higher while revenue growth was lower 
by 0.2 percentage points for qualifying businesses. However, neither impact was statistically different 
from zero. From 2012, once the qualifying threshold increased to $15,000 in El premiums, the credit is 
also not seen to have improved performance. Panel A.2. Year-over-year productivity and revenue 
growth for qualifying businesses increased respectively by about 3.2 and 1.6 percentage points. 
However, neither increase was statistically different from zero. 

Finally, for investment and R&D expenditures, the credit is also not seen to have had a positive impact. 
Panel B of Table 8 shows the absolute change in the investment and R&D rather than the percentage 
point difference in growth. Estimates ay show that in all except for the change in R&D for qualifying 
corporations in 2012, the impact of the HCSB was not statistically different from zero. Moreover, for 
R&D, the estimated impact suggests that the HCSB decreased expenditures by about $3,500 as this 
estimate is statistically significant at 1 per cent. 


For investment and R&D, the analysis is based on the absolute change in this measure because expressing the impact in terms of growth rates 
leaves this dependant measure undefined for the majority of businesses. A large share of firms did not undertake investment or R&D and so the 
growth rate, the dependant variable, of the local polynomial regressions is undefined. 
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Table 8: Regression discontinuity results for productivity, revenues, investment and R8iD 
expenditures 




Panel A; Percentage points 



Panel A.l: Year-over-yearfrom 2010 

Panel A.2; Year-over-year from 2012 


Productivity 

Revenue 

Productivity 

Revenue 

St 

6.138 

-0.190 

3.220 

1.563 


(10.712) 

(1.731) 

(16.18) 

(5.209) 

Bandwidth 

2,068 

2,117 

3,263 

2,139 

Observations 

32,757 

33,494 

29,173 

18,642 



Panel B; Absolute increase ($1,000) 


* 

Panel B.l: Year-over-year from 2010 

Panel B.2: Year-over-year from 2012 


Investment 

R&D 

Investment 

R&D 

ar 

-33.849 

2.018 

-4.247 

-3.488»* 


(22.290) 

(2.233) 

(7.369) 

(1.125) 

Bandwidth 

4,730 

6,267 

10,215 

4,859 

Observations 

85,952 

132,498 

134,839 

45,232 


Noie:ThU ubl«fhd«4 tht fiO cittmaiet for(h«(mpaet ofthe HCS6 foralbutinettei and for only tncofpoiated buthettei.Panel A Jand 
6 Icttimate the Incrementalifflpacionftrm growth from lOOto 2011 At a rctiitt.fotthete panels, the Indicator variable QuaUyh Equation {2) 
is dennedbyvihetherh20S,£lprrmlumt were no greater thart $ S,000. Panel A land OJ showtime year-over'year Impact of the credit from 
20Q. At a retull the indicator Qualdy in Equation (2) b defined by the$S,000 Clpremlutn threshold. Local area polynomial regressions are 
used to estimate the HCSB impact These rcgreitlortt utcatriangularkemello gbe observations closer to thequabficailon threshold more 
Influence. FlnjDy. a symmetric neighborhood using the stated bandwidth (eiprcised In doOars) around the Cl threshold Is implemented to 
determine (he sample. Significance bated on convenConal standard erroq ate shewn In parenthesis. **1 per cent significance. *S percent 
lignineance. 

In total, RD analysis is consistent with results from the DD regressions. Both methods suggest that the 
HCSB did not have a statistically significant impact on the performance of incumbent businesses. 

6.0 Entry 

This section analyses firm entry patterns to evaluate if the HCSB induced growth through its effect on 
new businesses. To this end, Section 6.1 tests if the credit helped more firms enter the market. Section 
6.2 uses DD regressions to examine if businesses that entered the market after the implementation of 
the credit on average: employed more workers, had greater payrolls, were more productive, earned 
more revenues, made greater investments or spent more in R&D. As above, the validity of using DD 
regressions is assessed by testing for pre-trends in the data. Appendix III presents these tests and 
provides evidence validating the use of DD regressions in this section. 

In the context of this study, the terms "new firm," "entrant" or "start-up" refer to the same type of firm. 
In a given year, this type of firm shows consistent evidence of employment (i.e. positive employment as 
suggested by the PD7 form, positive payrolls, and positive El premiums) after showing consistent signs 
of not employing anybody in the previous year. This can come about when a firm did not exist. It can 
also occur when a firm existed in the previous year but did not employ workers in that year. 

6.1 Entry counts and propensities 

One way the HCSB might have promoted growth was by helping more firms start up. This section studies 
this in two ways. The analysis first assess if the absolute number of entrants increased after the 
introduction of the HCSB. This is a preliminary attempt to see if the credit had an effect because general 
economic growth is likely to have led to an Increase in the number of start-ups. For this reason, the 
study also examines entry propensity patterns. This is done by benchmarking the number of entrants 
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against the number of all incumbent firms. However, benchmarking entry against all incumbents 
businesses allows the influence of many small incumbents that benefited from the credit to affect 
measured entry propensities; if the credit boosted the numbers of small incumbents, it would offset any 
relative increase in entrants that the credit also encouraged. As a result, to get a better sense of the 
HCSB, entry is also benchmarked against the numbers of incumbents that did not benefit from the 
credit. 


To assess if the number of entrants increased after the implementation of the HCSB, we use data from 
2007 to 2012 to estimate following equation, 

^it = oCpostPostPolicyt + ttt + <oit. (3) 


In Equation (3), reflects the number of firm entrants in the 2-digit NAICS industry / In year t. The 
entrant measure is in terms of either the absolute number of entrants or the entrant propensity, the 
number of entrants relative to incumbent firms. The variable PostPolicyt is an indicator variable that 
equals 1 when the year falls on or after the implementation of the HCSB. aj is industry fs fixed effect. In 
Equation (3), Opost is the key coefficient because It indicates by how much the number of entrants 
increased on average across industries once the credit was introduced. 


6.1.1 Entry counts 

With the absolute number of start-ups as the dependant variable, estimates of Equation (3) suggest the 
HCSB did not coincide with an increase in entry. Column (I) in Table 9 shows that, for all businesses, the 
number of entrants decreased by about 11 percent once the HCSB was introduction. However, because 
this estimate is not statistically significant, it appears that the number of entrants was largely 
unchanged. Similar, Column (II) shows entry patterns for incorporated firms were also unchanged; while 
the point estimate suggests that the number incorporated firms decreased by about 5 per cent, this 
change was not statistically significant. 


Table 9: Entry counts 


All 

Incorporated 

businesses 

businesses 

(1) 

(II) 


*post 

•0.111 

-0.047 

(0.065) 

(0.034) 

Industry-fixed effects 

YES 

YES 



058 

059 

Observations 

150 

150 


Note: TMf UM <liew> the esilcBeii of ttie My ceellicient In iQuliea III that eueuet tbe 
bnpicleftheKCSBenitiaebMhneiaM»lmabtreftmrejiii.tad(mnr*fi«td«lftcitareha«»d 
e»l*4itit NAIC9 todotriei «eie|erle».ieudt» ere baud enfeltsen Qwa»l>(MBtoumUk«niioed 
aMtaMloo.S (|aif Kenct litaMdeerabMl slaodarderrersthat ■tekhoaniAparemiwals. ** Iptf 
cenl«l|ninceiKC«*5pfrccAtil|nCficeac«. 


6.1.2 Entry propensity 

A simple way to improve the analysis of Section 6.1.1 is by benchmarking the number of start-ups 
against the number of incumbents. This would improve the analysis by helping somewhat control for 
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trends affecting the number of entrants but that are unrelated to the HCSB. In this section, this is done 
by using the entrant propensity (i.e. the ratio of entrants to incumbents) as the dependant variable in 
Equation (3). 

Overall, Table 10 shows the entrant propensity did not change in a statistically significant with the HCSB 
was introduced. For example, when all businesses are used to estimate Equation (3) and entrants are 
compared against all incumbents, Column (1) shows that the entrant propensity decreased by about 2.3 
percentage points. However, this change is not statically significant. Similarly, when focusing on only 
incorporated firms. Column (Ml) shows the entrant propensity decreased by 2.1 percentage points but 
that it was also not statistically insignificant. Qualitatively, the same conclusion is reached when 
incumbents that were too big to qualify for the HCSB benchmark the number of entrants. Columns (II) 
and (IV) of Table 10 show that the entry propensity declined in relative terms but that this change was 
not statistically significant. 

Table 10: Entry propensity _ 


All businesses _ Incorporated businesses 


Benchmark 

All 

incumbents 

(I) 

Non-qualifying 

Incumbents 

III) 

Ail 

incumbents 

(III) 

Non-qualifying 

Incumbents 

(IV) 

^post 

-0.023 

(0.013) 

-0.685 

(0.484) 

-0.021 

(0.014) 

-0.476 

(0.376) 

Industry-fixed effects 

YES 

YES 

YES 

YES 


0.7S4 

0.857 

0.700 

0.782 

Observations 

150 

150 

150 

150 


Note: This table shows the estimate of the key coefficient In Equation |3) that assesses the Impact of the HC58 on 
entry propensity. The dependent variable Is sImply the ratio of number of entering firm In eachS'dIgit NAIC5 Industry 
relative to the number of Incumbent firms In the same Industry. Benchmark refers to vvhat Incumtent firms entrants ore 
compared. Results arc based on OLS estimation.S%nif!cancc Is based on robust standard errors that are shown in 
parenthes b. ** Iper cent s Ignificance. *S per cent significance. 


6.2 Performance: Difference-in-difference 

Despite not finding evidence that the HCSB encouraged businesses entry, the credit could have helped 
improve the growth and the performance entering businesses. For example, entering firms could have 
been made bigger or more productivity. To address this question, this section uses DD regressions to 
assess if the performance of entrants improved with the credit's implementation. As a benchmark, these 
regressions use incumbents that would not have qualified for the credit. This is done specifically to 
minimize the potential influence that the credit might have had on benchmark firms. As in Section 6,1, 
not eliminating incumbents that qualified for the credit could make the average performance difference 
between entrants and benchmarks harder to observe; if the performance of benchmark firms Improved 
due to the credit, this improved performance would mitigate the relative observed improvement that 
the credit might have induced entering firms to have. 

In the context of the HCSB, the DD framework is implemented by using data from 2009 to 2012 to 
estimate the following equation, 

Yft = aTEntrantftXPostPolicyt -F ttEEntrantft + ccu + (4) 

Equation (4) is a simplified version of Equation (1). Specifically, given that entrants only appear once in 
the sample, it is not possible to use firm fixed effects as in Equation (1). Instead, 2-digit industry-year 


000021 



Uuuutiie; 1 Released unde r 

Access to Information 

Document divulgue en vertu de la 
Loi sur I'acces a linformaticn 

fixed effects (i.e. a^t) are used to control for composition effects of businesses over time. Otherwise, in 
Equation (4): 

• Yft reflects firm/s performance (e.g. employment, payroll, productivity) in year t; 

• Entrantft is a dummy variable that equals one when/is a start-up in year t; and, 

• PostPolicyt is a dummy that identifies sample years during which the HCSB was in effect (i.e. 

2011 and 2012). 

In this framework, the coefficient approximates the average difference in performance between 
entrants and incumbent firms before the implementation of the credit. As a result, the key parameter of 
interest is a^. This coefficient show by how much the initial average difference between entrants and 
incumbents changed with the implementation of the credit. 

As mentioned in Section 5.1, pre-trends in the data may Invalidate the estimates and conclusions based 
on DD regressions. As a result, to provide more convincing evidence. Appendix III presents analysis that 
tests for these pre-trends. In general, the results show no evidence of pre-trends in the data. 

6.2.1 Employment and payrolls 

The only evidence suggesting that the HCSB had a positive impact on Arm growth is with respect to the 
employment and payroll performance of entering firms. Specifically, the evidence suggests that 
unincorporated businesses that entered in 2011 or 2012 saw improved performance relative to 
benchmark Arms. This finding cannot be discounted but it needs to be considered cautiously given the 
abundant evidence suggesting that the HCSB generally did not have a positive impact on firm 
performance; randomness can be expected to lead occasionally to ^Ise positives. 

Panel A of Table 11 shows that, among all businesses in 2009 and 2010, entrants were substantially 
smaller than incumbents that were too big to qualify for the HCSB. For example, entrants employed 
about 350 per cent fewer workers. Column (I). This difference was stark enough to be statistically 
significant at one percent. More importantly, by being statistically significant at one percent, the 
estimates suggest that entrants grew in relative terms by closing the initial gap by 19 percentage points 
once the credit was introduced. Similarly, Column (II) shows that entrant payrolls were about 380 per 
cent lower than that of incumbents before the credit's introduction. However, incumbent payrolls 
increased relatively by about 26 percentage points with the introduction of the credit. This relative 
improvement in performance was statisticaily signifleant at five per cent. 

When the sample is limited to incorporated businesses, estimates of Equation (4) suggest that the credit 
did not have a positive impact on firm performance. Panei B of Table 11 shows that entrants were once 
again considerably smaller than incumbents. However, the introduction of the credit does not coincide 
with a relative increase in the size of entrants; the relative estimated increases in employment (10 
percentage points) and payrolls (3 percentage points) are not statistically significant. 

In total, the statistical significance and magnitude of estimates for between Panel A and B allude that 
unincorporated entrants benefltted from the HCSB; these firms seem entirely responsible for the 
statistical significance of the estimated impact of the credit in Panel A. 
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Table 11; Dlfferenceln-dlfference Impact estimates for entrants. 2009-2012 > _ 


A: All businesses_ B: Incorporated businesses 


Dependent variable 

Employment 

Payroll 

Employmoit 

Payroll 


(1) 

(II) 

(III) 

(IV) 

ttf 

0.185** 

0.264* 

0.098 

0X>30 


(0.061) 

(0.124) 

(0D60) 

(0.086) 


-3.S38** 

-3J33** 

-2566** 

-3J38** 


(0.037) 

(0.058) 

(0.049) 

(0J)72) 

lndustry>year fixed 

YES 

YES 

YES 

YES 

effects 






0.2S 

0.26 

OJIS 

0.17 

Observations 

584,160 

584,160 

430,449 

430,449 


Nats; TMt UbN ihow kty cosHtettnt ailhiiUi for Equstisn W- ksnsi A b bitsd on dtn fmin sO butbMiiot (U. 
huoipotiud tnd uahcoipontsd builnstiu) tdiSs PtnsI B b bMcd only on tocoiponud buslnsitsi. bidusBy^tr (btd 
sfhctt sra btiid an 2-d(|b NAKS btdutttycalsiadu.Baacbmiik buslUMai sn those thstbi • (Ntnyttt.dld nolQBaHyisr 
tht HCSe. Rttubt srs bated on Pobton oiuikaiilnuffl EkoSuod stttnaUon. Blinlikance b bated sn lobutt ttandaid 
oiioisthataiathawilnptmnthetb.*‘lporcentt||adbaneo.*SpcrcenttlinBlctneo. 


6.2.2 Productivity, revenues, investment and R&D spending 

The HCSB does not seem to have promoted productivity, revenue, investment and R&D spending 
growth for incorporated firms that entered the market in 2011 or 2012. Table 12 presents estimates of 
Equation (4) when these different margins are used as the dependent variable and when the sample of 
firms considered is limited to only incorporated firms. In general, entrants are estimated to have been 
smaller in a statistically significant way than incumbents before the implementation of the HCSB. For 
example, entrants were about 75 per cent less productive than incumbents. Similarly, entrant R&D 
spending was about 320 per cent lower than that of incumbents. More importantly, with the 
introduction of the credit, these initial differences did not change in a meaningful way. For productivity, 
entrants could have become less productive by about 14 percentage points. It is instead more likeiy that 
the initial difference was unchanged because the estimated change is not statistically significant. 
Similarly for R&D spending, the point estimate for suggests that entrants decreased their spending 
by an additional 30 percentage points but because this change was statistically insignificant, the HCSB 
does not seem to have had an impact. 
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Table 12: Difference-1n-difference impact estimates for entrants, 2009-2012 _ 


Dependent variable 

Productivity 

Revenues 

Investment 

R8tD 


(1) 

(M) 

(III) 

(IV) 

ay 

-0.144 

0.114 

-0.625 

-0.302 


(0.142) 

(0.080) 

(0.436) 

(0.317) 


-0.748** 

-3.101** 

-0.809* 

-3.222** 


(0.138) 

(0.059) 

(0.340) 

(0.178) 

Industry-year fixed 

YES 

YES 

YES 

YES 

effects 






0.19 

0.18 

0.15 

0.24 

Observations 

411,700 

429,624 

430,449 

430,449 


Note: This table shows key coefficient estimates for Equation (A). Panel A Is based on data from all businesses (1^. 
Incorporated and unincorporated bus Inesscs^whlte PaneIG is based ontyon Incorporated businesses. Indus try^year fixed 
effects are based on 2-dlgil NAtCS Industry categories. Genchmaik businesses are those that, In a given year, did not 
qualify for the HCSB. Results are based on Poisson quashmaxlmum likelihood estimation. Significance Is based on 
robust standard errors that are shown In parcnthesis.**lpercentslgnincance,*S percent significance. 


Overall, the evidence on the possible impact the HCSB might have had on entrants is mixed. DD results 
suggest that the credit might have helped induce the entry of unincorporated firms that were larger in 
terms of employment and payrolls. Otherwise, consistent with all other results presented in this paper, 
the credit does not seem to have had an impact on entrants: the credit does not seem to have helped 
more businesses to enter nor^ does it seem have improved the performance of incorporated firms on any 
dimension. 

7.0 Conclusion 

This study assess if the HCSB implemented from 2011 to 2013 succeeded in promoting the performance 
of eligible firms. Multiple empirical techniques meant to infer the causal impact of the credit were used. 
Moreover, the analysis has looked for a potential impact over various firm outcomes (i.e. employment, 
payrolls, productivity, revenues, investment and R&D spending). All told, the introduction of the credit 
does not seem to have had a meaningful impact. Some evidence is found that the credit increased the 
erhploymentand payrolls of unincorporated start-ups. However, judged against the preponderance of 
evidence as well the possibility that due to randomness it is possible to obtain false positives, these two 
positive results should be considered cautiously. 

A potential reason why the credit was generally ineffective at improving firm performance is that it was 
unconditional; firms automatically qualified for the credit if their El premiums were low enough and 
they did not need to improve their performance to receive any benefit. Another potential reason why 
the credit seemed ineffective is that the subsidy was small. As a share of broader labour costs (i.e. the 
combined cost of payrolls and El employer premiums), the credit was usually no greater than two per 
cent for different types of businesses and on average, for all businesses, was less than one per cent. 

The analysis in this study attempts to be definitive but various caveats are still necessary. One important 
consideration is that the specification of the DD regressions are parsimonious. For example, variables 
controlling for time varying firm characteristics are not used. As a result, omitted variables could bias 
the results. Despite this, it Is unknown in what direction the bias could work; if a bias exists, it is 
uncertain whether it would change results dramatically enough to suggest that the credit helped 
improve performance. As well, at least for the analysis of incumbent businesses, the RD analysis that is 
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unaffected by misspecification, corroborates the conclusion from DD estimates that the HCSB did not 
promote firm performance. 

Another potential caveat is that the impact of the credit could have been too diffused to be observed in 
the data. For example, some firms might have used the credit to hire relatively more workers. Others 
might have paid existing workers more while still other firms might have invested the credit on a new 
piece of machinery or in R&D. Consequently, given the level of noise in the data, improvements in firm 
performance along any one margin might have been spread too thinly to be observed. 
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Annex I: Incumbent pre-trends 

To make DD regression results convincing, studies using this method test for pre-trends in the data. 
Ultimately, these tests are intended to bolster the underlying assumption that entities unaffected by a 
policy serve as a good benchmark for how affected entities would have performed without the policy. 

In this study, pre-tends are tested by replicating the analysis described in Section 5.1 with two 
alterations. First, estimation of Equation (1) uses data from the 2007-2010 period rather than the 2009- 
2012 period. And, second, the definition of the variable PostPolicyt in Equation (1) is changed so that it 
equals one for observation in 2009 and 2010. In this framework, the pre-trend test is a placebo test. 

Given the HCSB was implemented after 2010, pretending the credit was in effect in 2009 and 2010 
should leave estimates of a-p statistically insignificant. Finding evidence to the contrary would suggest 
that diverging trends in the data existed prior to the HCSB and that their possible continuation could 
influence DD estimates of the credit's impact.^’ 

Pre-trend test results do not show evidence of divergences in the data prior to 2011 for employment, 
payrolls and productivity. However, there is some evidence of pre-trends for revenues, investment and 
R&D spending. Estimates of and ap from Equation (1) in Panel A of Table Annex I are based on the 
sample of all businesses when employment and payrolls are used as the dependant variables. As should 
be expected, businesses that would have qualified for the credit were smaller on average; the estimate 
of Ue is negative and statistically significant and suggests qualifying firms employed about 21 per cent 
fewer people and had payrolls that were about 25 per cent lower than businesses that would not have 
qualified for the credit. More importantly, these differences did not change over time (i.e. after 2008); 
estimates of Up are small in magnitude and statistically Insignificant. This finding suggests no pre-trends 
exist in the data that could influence the findings in Section 5.1 when employment and payrolls are used 
as the performance outcomes. 

For incorporated firms, the estimates of a-p also suggest that there were no pre-trends for employment 
and payrolls. Panel B of Table Annex I suggests that these coefficients are also statistically insignificant. 
Moreover, this table also shows that firm productivity did not have pre-trends. The point estimate of Up 
is negative but it is not statistically different from zero when productivity is used as the dependent 
variable. 

In contrast, the last three columns of Panel B in Table Annex I suggest that pre-trends existed for 
revenues, investment and R8iD investments. Revenues of businesses that would have qualified for the 
credit were about 17 per cent lower than for businesses that would not have qualified. More 
importantly, these results suggest that revenues on average decreased in relative terms by 2.6 
percentage points. Given the statistical significance at five percent for this estimate, ap suggests that 
pre-existing trends in the data prior to the credit's introduction could invalidate DD analysis searching 
for the impact of the credit over the 2009-2012 period. 

For investment and R&D expenditures. Panel B of Table Annex I shows evidence suggesting pre-trends 
existed that could exaggerate the positive impact of the HCSB. For both performance measures, 
businesses that would have qualified for the credit are seen to have increased investment or R&D 
spending versus non-qualifying firms. Given this observed increased occurred prior to when the HCSB 


Alternatively, a statistically significant estimate of a-r could suggest that time-varying variables in Equation (1) are omitted, generally biasing 
estimates of 
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was actually implemented, it suggests that pre-trends existed that would lead estimates of the impact of 
the credit to positive. 

As a result of test results in this section. Section 5.1 focuses on performance dimensions that do not 
seem to have had pre-trends (i.e. employment, payrolls and productivity). Analysis for revenues, 
investment and R&D spending are excluded from Section 5.1 given that they might be influenced by the 
pre-trends identified in this Annex. However, though not shown, the point estimates of a-p for these 
performance margins based on data between 2009 and 2012 do not indicate that the HCSB had a 
positive impact; estimates are,either negative or statistically insignificant if positive. 


Table Annex I; Diffcrence-ln-differcnce impact estimates for Incumbents, 2007-2010 


A: All businesses _ B: Incoroporated businesses 


Estimation method 

Poisson 

Poisson 

Poisson 

Poisson 

Poisson 

Poisson 

OIS 

015 

Dependant variable 

Employment 

Payroll 

Employment 

Payroll 

Productivity 

Revenues 

Investment 

R8<D 

“r 

0.002 

0.00S 

O.OOS 

0.006 

.0.009 

■0.026* 

42.4* 

11.3* 


(0.004) 

(0.004) 

(0.004) 

(0.00S) 

(0.032) 

(0.011) 

(20.3) 

(5.3) 


-0.213** 

-0.249** 

-0.213** 

-0.249** 

0.023 

-0.169** 

-9.2 

-12.1** 


(0.006) 

(0.009) 

(0.006) 

(0.0Q8) 

(0.029) 

(0.024) 

(11.5) 

(3.1) 

Firm-fixed effects 

YES 

YES 

YES 

YES 

YES 

YES 

YES 

YE5 

Year-fixed effects 

YES 

YES 

YES 

YES 

YES 

YES 

YES 

YES 


0.99 

0.99 

0.99 

0.99 

0.72 

0.96 

0.657 

0.921 

Observations 

2,084,270 

2,084,270 

1,513,710 

1,513,710 

1,425,553 

1,503393 

1,514,352 

1314,352 


Note: This tabto f«rf<)uition(9.P4netA U bated endat* fremalfinn«(U. tneorporated and unincorporated buiinetie)) while Panel B b bated enlyen Incorporated buiIneitci.Thr 

number of obi erviUont differdepertdingort the dependent variable utcdbccautedau forthetevarUbSei maybe mlttlni for different obtervationi.$amplet maybe unbalanced due to mltilni NAKS Infomiaten Inipme 
tean.induttryifearltiedeffectj are bated onS’dijitNAlCS claitci.PobfonouaihmailmumlkchhoodettimatJortlt uiedio ettimiteCQwaUon (S.Aobuti lUndarderrprt inpareniheset.**lfcrecrtttl|niricarKe,*Spet 
ecntiicndicanee. 

Annex II: Tests to validate RD analysis 

4.2.1 Manipulation 

The RD analysis performed in this paper can be invalidated if businesses had sufficient control of the El 
premiums they paid to determine whether they would qualify for the HCSB. Such control ultimately can 
lead to biased impact estimates. For example, a business that foresees it will expand its workforce next 
year might find it beneficial to qualify for the credit in the current year by curtailing its employment in 
the current year. In this situation, RD estimates are exaggerated. Growth that would have happened 
anyway would be attributed to the credit. Moreover, "fake" growth would occur if the firm undoes the 
decrease in employment it undertook solely to qualify for the credit. This extra growth would also be 
attributed to the credit. Ultimately, manipulation is troublesome because firms that were just unable to 
qualify for the credit would not be comparable to those firms that managed to qualify. 

A priori, in the context of the HCSB, it is unlikely firms were able to manipulate their El premiums in 
2010 and 2012. This is because the qualifying thresholds were unknown. The $10,000 threshold for 2010 
was first announced in Budget 2011, after 2010 employer El premiums should have been determined. 
Similarly, the $15,000 threshold for 2012 was first announced in Budget 2013, after 2012 employer El 
premiums should have been determined. Therefore, it does not seem possible that firms had reasonable 
control to target their position around the HCSB thresholds. 


Sole reliance on the argument why firms were unable to manipulate their El premiums is unnecessary to 
substantiate the use of RD. McCrary (2008) proposes a direct test of manipulation by examining the 
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distribution of businesses close to the qualifying thresholds. If businesses were unable to manipulate 
precisely their El premiums then, the distribution around the threshold should be smooth. In contrast. If 
there was manipulation, one should expect a conspicuous clustering of firms below the threshold and a 
conspicuous ebb after the threshold as businesses above managed to fall below the threshold to qualify 
for the credit. This would result in a discontinuous change in the distribution from one side of the 
qualifying threshold to the other. 

Table Annex II.A presents the McCrary test for distribution of firms over El premiums at the qualifying 
cut-offs iri 2010 and 2012. The null hypothesis is that there is no log discontinuity (i.e. firms did not 
manipulate). Overall, no evidence is evident that firms manipulated their El premiums; the measured 
discontinuities at the thresholds are too small relative to their standard errors to suggest statistically 
significant jumps in the distribution. For example, for all businesses in 2010, the log discontinuity was 
0.019 and the standard error was 0.020. As a result the t-statistic is less than one and too small to reflect 
a statistically significant discontinuity at five per cent or better. Similarly, for incorporated businesses in 
2010, the log discontinuity was 0.028 while the standard error was 0.020. The related t-statistic is again 
too small to be statistically significant at five per cent or better. 

Table Annex II.A: McCrary (2008) discontinuity test _ 


All businesses Incorporated businesses 


2010 

2012 

2010 

2012 

Log discontinuity 0.019 

-0.004 

0.028 

-0.013 

(0.020) 

(0.024) 

(0.020) 

(0.024) 


Note: Test of the McCnrydiscontlnulty tettthovm wftfiilandard erron In parentheils.ThB retuUng i* 

itatbticf are too cmadie rajeettho miOof adhcontbiuityatthe HCSB threiholds atflve percent aignlflcanee or 
better.TheNCSS qualifyingthreshoMs ln20Vand208were$li/7(K)andSS/l(H)refpectfvefy. 

4.2.2 Ex-ante differences 

Given that there was no manipulation, the RD analysis might still be flawed if firms below and above the 
threshold are not sufficiently similar to each other. If this is the case then, businesses above the 
qualifying threshold cannot be considered to be a good benchmark against which to assess the impact of 
the credit. 

To verify if businesses are sufficiently similar, we estimate Equation (2) on different pre-determined 
characteristics.^^ That is, the RD analysis is used to assess if there are observable differences between 
firms above and below the qualifying threshold in the year before El premiums determine if firms 
qualified for the HCSB. For example, to see if firms that qualified for the HCSB based on the premiums 
they paid in 2010, we estimate if there were differences between firms based on characteristics in 2009. 
For the sample of all businesses, the "cqvarlates" are mostly the level form of the same variables used to 
assess if the HCSB promoted performance: employment and payrolls. For incorporated firms the pre¬ 
determined characteristics are the levels of: total assets, productivity, revenues, investment, R8iD and 
the incidence to undertake R&D. In general, there are no significant differences in the average level of 
these characteristics between firms above and below the qualifying thresholds.” 


Equation (2) is estimated using a polynomial order of 1. 

To economize on vetting time needed to release results from Statistics Canada, employment and payrolls are not used to test if incorporated 
businesses above and below the qualifying thresholds differ. 
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Table Appendix II.B shows the average difference in covariate values of firms found below and above the 
qualifying threshold. Generally, no pre-existing differences between these businesses are found. Though 
the differences were at times large, these differences were not systematic enough to conclude that 
businesses above the threshold would not be a good benchmark for those below the threshold. As well, 
though there seems to be a difference in the incidence to conduct R&D in 2010 for incorporated 
businesses, this does not jeopardize the use of RD. This was the only statically significand difference and 
the difference seems economically small at only about 1.7 percentage points. Consequently, the 
evidence in Table Appendix II.B suggests the firms above the threshold are sufficiently similar to those 
that qualified for the HCSB to serve as a benchmark to assess the credit's impact. 


Table Appendix II.B: Pre-determlned covariate test 


Bandwidth 

Number of Average 

Standard 


observations difference 

error 


A; All businesses 



Qualifying year: 2010 


Workers 

4,359 

85,798 

0.102 

0.1829 

T4 Payroll 

5,877 

134,345 

5,502.65 

7318 

Qualifying year: 2012 





Workers 

5,301 

%311 

-0.078 

0.24194 

T4 Payroll 

4,396 

44,495 

5,249.91 

12327 



B: Incorporated businesses 


Qualifying year: 2010 





Total Assets 

4,135 

72,694 

■1,227,779 

3783574 

Productivity 

7,465 

188,185 

. 1.28 

3.443 

Revenues 

5,448 

106,579 

-92,702 

278367 

Investment 

4,387 

78,436 

-2,022 

6380 

R&O 

4,097 

71,808 

-2,954 

1695 

R&D Incidence 

3,044 

50,247 

-0.017 •• 

0.005 

Qualifying year: 2012 





Total Assets 

8,585 

98,972 

-4,998,880 

3753496 

Productivity 

6,438 

64,700 

-6.50 

5.885 

Revenues 

3,696 

33,740 

132,321 

367657 

Investment 

18,711 

466,092 

-29,845 

21965 

R&D 

7,557 

80,986 

928 

2056 

R&D Incidence 

7,057 

1 

73,433 

0.003 

0.005 


Net*: Rcfutu «if taied on lecil area potunomial rcgreaslon of order It/langubr kernel and a tYmmelrlc bandwidth. Valuei on which 
butfaiessci are compared are from the year before the quatdying year. £1 premiums In the quardying yearaie utedio delermirte which 
businefics quahfyandwhkhdo net.S(sni(kancebascdoncon«cr)tioitalstandarderrors.*,*repreienis tuuttleal significance at land 
S percent respective^. 

Annex III: Entrant pre-trends 

This annex tests for pre-trends in the data that would weaken analysis in Section 6.2 that tests whether 
the HCSB had an impact on the performance of entering businesses. This is done by replicating the 
analysis described in Section 6.2 with data from 2007 to 2010 and by redefining the variable 
PostPolicyt to equal one for observations from 2009 and 2010. As in Annex I, this pre-trend test is a 
placebo test because estimation of Equation (4) is based on a sample period that preceded the 
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introduction of the credit. Evidence that the performance of firms that would have qualified for the 
credit had it been introduced in 2009 improved, would suggest the existence of pre-trends. 

Test results do not find evidence of pre-existing trends in any of the outcome variables used in Section 
6.2. As a result, all outcome variables are used in Section 6.2. The next two subsections present the pre¬ 
trend test results. 

Employment and payrolls 

Panel A of Table Annex III.A shows that over the 2007-2010 period, all businesses that started up and 
would have qualified for the HCSB were 350 per cent smaller in terms of employment than incumbent 
firms that would not have qualified for the credit. Similarly, for payrolls, entrants were 370 per cent 
smaller. More importantly, these initial differences did not change over time. For example, the point 
estimate for employment suggests that the difference decreased by 0.4 percentage points. However, 
this change was statistically insignificant. Similarly, for payrolls the point estimate suggests that the 
initial difference could have widened by 9.1 percentage points but this estimate is statistically 
insignificant as well. 

The qualitative conclusions remain unchanged when the sample is limited to only incorporated firms. 

Panel B of Table Annex III.B show entrants were smaller than incumbents on average over the 2007- 
2008 period. As well, this table shows that these differences remained unchanged over the latter part of 
the sample period; the point estimates of a-p are statistically insignificant. As a result, no evidence that 
pre-trends exist is found. 


Table Annex III.A: Dlfference^ln-dlfference Impact estimates for entranb, 2007-2010 


A: Ail businesses _ B; Incorporated businesses 


Dependent variable 

Employment 

Payroll 

Employment 

Payroll 


(I) 

(ll) 

(111) 

(IV) 

OCf 

0.004 

t0.091 

-0.082 

-0.189 


(0.0S7) 

(0.094) 

(0.066) 

(0.104) 


-3.542‘* 

-3.741** 

-2.884** 

-3.049** 


(0.043) 

(0.074) 

(0.044) 

(0.075) 

Industry-year fixed 

YES 

YES 

YES 

YES 

effects 






0.26 

0.26 

0.15 

0.17 

Observations 

584,532 

584,532 

420,429 

420,429 


Note: Thl5 bble sham key coefficient estimates foe EquaUon (4|. Panel A Is based on data from all businesses (l.e. 
Incorporated and unincorporated businesses} while Panel B Is based onfyon Incorporated businesses. Industry-year fixed 
effects are based on 2*d(glt NAICS lhdustrycategorfes.fi enchmarfc businesses are those that In a given year, did notqualifyfor 
the HCSB, Results are based on Pobson quasi-maximum likelihood estimation. Significance b based on robust standard 
errors that arc shown in parenthesb.**lpercent significance, *5 pcrccntslgnlficancc. 


Productivity, revenues, investment and R&D expenditures 

Table Annex III.B also shows no evidence that pre-trends exist in the data for productivity, revenues, 
investment, and R&D expenditures. Among, incorporated businesses, entrants were generally much 
smaller on average than incumbents. This was especially so with respect to revenues and R&D 
expenditures where entrants are seen respectively to have been about 300 and 260 per cent smaller. 
More importantly, the table does not show evidence of pre-trends in any of the four variables. 
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Specifically, estimates of a-p for these variables are statistically insignificant. Consequently, no pre¬ 
existing trends in the data are found that might linger to influence the results in Section 6.2. 


Table Annex III.B: DIfference-ln-dIfference Impact estimates for entrants, 2007-2010 


Dependent variable 

Productivity 

Revenues 

Investment 

R&D 


ID 

(ID 

(III) 

(IV) 

Ur 

0.127 

-0.107 

0.384 

-0.585 


(0.148) 

(0.134) 

(0.373) 

(0.444) 


-0.876** 

-2.995** 

-1.193** 

-2.637** 


(0.054) 

(0.120) 

(0.155) 

(0.407) 

Industry.year fixed 

YES 

YES 

YES 

YES 

effects 



S 



0.20 

0.18 

0.15 

0.24 

Observations 

401349 

419345 

420,429 

420,429 


Note: This tabte shows key coefffctent estlmatei for EQtiation |4). Panel A Is based on data from all businesses (I'b. 
Incorporated and unincorporated businesses) white Panel B Is based only on Incorporated businesses. IndustiV'Vearfbied 
effects are based on 2-dtglt NAICS Industry categories, fienchmaifc businesses are those that; In a given year, did not 
qualify for the HCSB. Aesults are based on Poisson quaslnnaxlmun) likelihood estimation. Significance b based on 
robust standard errors tfiatare shown in parenthesis. **lpercent significance, *5 per cent significance. 


/ 
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